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The extremization of an appropriate entropic functional may yield to the probability distribution 
functions maximizing the respective entropic structure. This procedure is known in Statistical 
Mechanics and Information Theory as Jaynes' Formalism and has been up to now a standard 
methodology for deriving the aforementioned distributions. However, the results of this formalism 
do not always coincide with the ones obtained following different approaches. In this study we 
analyse these inconsistencies in detail and demonstrate that Jaynes' formalism leads to correct 
results only for specific entropy definitions. 
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I. INTRODUCTION 

Jaynes' Formalism (JF) |1| of the maximum entropy principle applied on the Boltzmann-Gibbs-Shannon (BGS) 
entropy Q 

f[(i/pi) Pi ) = Y / pMi/p i ) (i) 

reproduce correctly the exponential maximum Probability Distribution Functions (PDFs), obtained from the theory 
of thermodynamics. fl^S* i s the maximum configuration function of the BGS-statistical ensemble and pi are the 
associated configuration probabilities. This celebrated result has established the above formalism as a standard 
procedure for the computation of the maximum PDFs for an arbitrary generalized entropic structure Sq [!, 0, [H, IE j 
where Q — {Qi}i=i,..., n is a set of parameters. For specific values of these parameters, Q — > Qo, the quantity Sq 
tends to Sbgs m Eq. CD). In JF the probability functional 

I(Pi) = S Q ( Pl ) -a^P,-^^ g(pi) (2) 

i i 

is extremized, namely, 8X{pi) = 0. The constants a and are the Lagrange multipliers associated to the normalization 
and mean value constraint Q2 iP i, X^-^i 9(Pi))i respectively. For q fa) := Pi we have the Ordinary Mean Value 
(OMV) definition. In the frame of generalized thermostatistics [1, M, [l(| a common definition of the mean value is 
g{pi) '■— Pi / ^2kPk' where q is the generalization parameter of the respective entropy. This definition is called Escort 
Mean Value (EMV). Ei is the observed quantity for a system under consideration. 

Some well known generalized entropic structures, which have been explored within JF are the one-parametric Tsallis 
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Sj @|, Renyi [U and Nonextensive Gaussian (NeG) Sf [3 ones, denned as 



= 22 pikLq(l/pi) { s J->i = Sbgs) , (3) 



R m (Z)i=T x i . , 

<Sr = i Wr— 1 = S'bGSJ 7 (4) 




S * = K II (Vftr (5^1 = ^BGS) , (5) 



where f^max' G are the respective maximum configuration functions and hi^(x) is the deformed logarithm defined by 
Tsallis and collaborators 

h$(x) := X (a;>0,In^ 1 (a:) = In(x)). (6) 

All of these entropies are based on the generalized logarithmic function ([6]) and its inverse function 

expj(x) := [1 + (1 - q)x]\T 9 f lim expj(a;) = cxp(ir) j . ! 7 ) 

with [X] , = max{0, V}. Indeed, considering the deformed g-product [13, HH HE] defined within generalized thermo- 
statistics, we find the mathematical relation 



(8) 



Comparing Eq. (|SJ) with Eq. we see that the earlier is the r-generalized inner structure of the BGS-entropy. The 
application of the deformed logarithm ^ on Eq. ([5]) leads to Renyi, Tsallis and NeG-entropy for q — > 1, r — > q and 
r — > 1 respectively. 

The application of Eq ([2]) on and S'J 1 using OMV and EMV yields a ^-exponential as in Eq. ([7]) and a (2 — g)- 
exponential PDF [l6|, [ItJ , respectively 

expj„ ? (x) := [1 + (g - l)z]| _1 ^lim exp^_ q (x) = exp(a;)^ . (9) 

This result may be verified through the monotonic relation between Sj and for r = q and f2 T ax = ^max 

Sf = In [cxp, (Sj)] , (10) 

which is often used in literature [H, [2(| ■ In case of Sff, one obtains from JF using Eq. ([2]) with EMV, a PDF of 
the form g£-exponential [2lj 



C, \ [W[{l-q)x] 
exp^(x) := exp f 



(expf_ fl (x) = exp(x)) , (11) 



V 1-9 

where W[x] is the TV-Lambert function [22j. The NeG-entropy has not been studied explicitly for OMV. However, it 
is easy to see that in this case one would obtain ordinary exponential distributions, since 

^^~£(i + Mp<)). (12) 

i 

In a recent study [lj| one of us (TO) has constructed two Generalized Multinomial Coefficients (GMC), C^ p ^ Qy 
and C^ p ^ g j, based on different generalized factorial operators, xl^Q^y and xl^ n y, from which Sj, and 

may be derived. Q and 7?. are two sets of parameters, Q = {Qi\i=i,..., n and TZ- = {Ri\i=i,...,m- Then, the relation 
between these parameter sets and the parameters in Sj , and «S* is given by Q = Q\ = q and 1Z = R± = r. The 
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results about the maximum PDFs for the Tsallis entropy computed from C^ p ^ g j are in accordance with Eq. ([7]) 
and computed from C^ p ^ gj are in accordance with Eq. (|9|) 15]. Furthermore, in both cases the g-ranges were 
determined, namely q G [0,1] and q 1, respectively. However, in the case of Renyi and NeG entropy the results 
obtained from GMC are different from the ones obtained from JF. The Renyi entropy is maximized for ordinary 
exponential distributions (with r £ [0, 1] for both CMC's) and the Nonextensive Gaussian entropy is maximized for 
q- and (2 — g)-exponential distributions in Eqs. ([7]) and ([5]), for q ^ 1 and q 1, respectively [HI]. These GMC results 
have a consequence that Eq. (flC)]) is physically (r ^ q) and mathematically (f^max ^ ^max) incorrect. 

The above mentioned discrepancies in the last paragraph indicate a problem in the mathematical structure either 
of JF or of GMC, since they may yield different results computing the maximum PDF of an entropy definition. In 
the present manuscript we would like to explore which mathematical approach gives proper results and determine the 
origin of the problem in the respective approach. In Section UH based on the concept of extensivity, we argue why the 
results of JF are in general incorrect. In Section HTll we investigate the entropic structures on which JF is applicable. 
In the last section we draw our conclusions. 

II. GMC, JF AND THE InJ-ENTROPIES 

A general expression of a deformed entropic structure may be given in the following way 

s Q ■■= E A Q fe) = <r = J2 Pi i^(v«). (13) 

i=l i=l P % i=l 

where lng(l/pi) := h.Q(pi)/pi is a deformed logarithm and for specific values of its parameters, Q — > Qo, it tends to 
the ordinary definition of the logarithmic function. In shake of simplicity, in what follows we shall consider Sq for 
equal configuration probabilities, pi = l/J7n7a X , without losing the generality of the results. Then, we obtain 



5 s (max)=ln Q (n^ x ). (14) 

We recall at this point that a very important property of an entropic form is its extensivity with respect to the variable 
under consideration. For instance, such a variable in thermodynamics may be the size N of a statistical system. Then, 
the entropy production of the system must be proportional to N. Taking into account Eq. (TT4")) , it becomes evident 

that the maximum configuration function has to present the inverse structure of the deformed logarithm big, 

namely, exp Q . If the system under consideration comprises W different types of elements, then fi^lx takes the form 

:= ex Ps W(Q) \n Q (Wj) , (15) 

under the constraints 

lim 0(Q) = 1, lim fig» = cxp (N ln(W)) = W N = fij^ x s . (16) 

Using the GMC approach, Eqs. (fT5")) and (fH))) have been analytically derived in the specific case of Tsallis entropy 
[HI and can be shown to be valid for any entropic structure of the form lfT3]) [23| . Replacing Eq. (fT5]) in Eq. (fT4]) we 
obtain the desired extensivity with respect to N: 

S Q (max) = Ncj>(Q) \n Q (W). (17) 

As can be seen in Eq. (fT7| . the function 4>{Q) in thermodynamics may be related to a generalized Boltzmann 
constant. Returning to the results of GMC and JF for Sj, and S^f we make in the following subsections some 
crucial comments, which have not be considered explicitly in literature up to now. 

A. GMC, JF and Tsallis entropy 

As discussed in the introduction the application of JF on Tsallis entropy leads to g-exponential and (2 — q)- 
exponential distributions for ordinary and escort mean values, respectively. However, it is easy to verify considering 
S'J(max), that PDFs of g-exponential type makes Sj extensive, since it is the inverse lnj -function, while PDFs of 
(2 — g)-exponential form do not. According to GMC approach, the g-exponential distributions are obtained from 
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the definition C|g P * =g q y with g G [0, 1] and the (2 — g)-exponential distributions are obtained from the definition 
C{0 P r=q , with q ^ 1. Comparing the results of both approaches, we conclude that the PDFs which maximize Sj 
are the g-exponential ones, (j>i — 1/ exp q (x) and not pi = exp 9 (— x) — 1/ exp 2 _ (J (x)), with ordinary mean values and 
q G [0, 1]. We notice that, the distribution pi = exp 9 (— x) = 1/ exp 2 _ g (x) maximizes the entropy Sj_ q with ordinary 
mean values. ^From GMC we determine the range of g-values for 5 l 2 r _ g which vary between q G [1, 2]. As can be seen, 
the distinction between exp g and exp 2 _ 9 is very important since they are related to different entropic structures. It 
is a very common mistake in literature to consider a exp g (— x) distribution calling it g-exponential, although it is a 
(2 — g)-exponential distribution. This is the reason of obtaining in these cases a g-value greater than unity. 



B. GMC, JF and Renyi entropy 

Same as in case of Sj , the application of JF on Renyi entropy leads to g-exponential and (2 — g)-exponential 
distributions for ordinary and escort mean values, respectively. The external function of (max) is an ordinary 
logarithm, thus none of the aforementioned distributions makes Renyi entropy extensive. According to GMC approach, 
for both GMC-definitions is defined for r G [0, 1] and is maximized for ordinary exponential distributions. These 
results are in agreement with the concept of extensivity. In Fig. [T] we present some plots of the Renyi entropy for 
equal probabilities and W = 2 types of elements, considering the JF maximum PDFs given by Pi = 1/ exp r (iVln r (2)) 
and the GMC maximum PDFs given by pi — 1/ exp r _ tl (N ln r _>i (2)) = 2~ N . As can be seen, and argued above, we 
obtain extensivity only for r — 1. Additionally, when the entropic parameter varies in the range r G [0, 1), the values 
of (max) are smaller than the ones for r = 1. Thus, PDFs obtained from JF do clearly not maximize the Renyi 
entropy. 



C. GMC, JF and NeG entropy 



In case of Nonextensive Gaussian entropy one obtains from JF with ordinary and escort mean value constraints ordi- 
nary and g£-exponential distributions. However, considering (max) = ln^(f^ ax ), we verify that both distributions 
do not preserve extensivity. The PDFs which maximize are g-exponential distributions, as in Eq. ([7]). Taking into 
account the results obtained from the GMC, we see that PDFs of g-exponential type are derived from the definition 
C{0 P r=i q } w hh g ^ 1. In Fig. [5] we present in analogy to Fig. [1] three plots of the equiprobabilized NeG-entropy, 
based on an ordinary, q- and g£-exponential distribution. Again we see that the extensivity is preserved only for the 
g-exponential PDF, while the values of based on the g^-exponential PDF are lower than the ones based on the 

^{Qr=i f° r ^ ne same g-value. Accordingly, the NeG-entropy is optimized by PDFs of g-exponential type. 

The above discussion implies, with regard to GMC approach, that only the definition C^ p ^. =1 q -. gives proper 
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FIG. 2: Plots of 5° for equal probabilities pf MC = 1/ exp^(iV In, (2)), 
l/exp(JVln(2)) for q = 0.9. 
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results, and with regard to JF, that the correctness of the obtained maximum PDFs for an entropic structure is 
not guaranteed. In the next section we shall demonstrate the origin of the observed inconsistencies within JF. The 
computation of the maximum PDF for a given entropic definition and the determination of the parameter range 
through the respective GMC is not part of the scope of this article and will be explored separately. 



III. JF AND GENERALIZED LOGARITHMS 



Let us first consider the BGS-entropy in Eq. JT]). The inner structure of Sbgs is of the form A(x) = Aq (x) 
xhi(l/x). Then, the derivation with respect to the variable x gives 



dx 



A(x) =\n(l/x) 



x— ln(l/x) 
dx 



ln(l/x) 



(18) 



As can be seen in the right hand side of Eq. (fT8"|) , the reason of obtaining exponential PDFs in JF for the BGS-entropy, 
is the remaining logarithmic dependence on x, ln(l/a;). Since the exponential function is the inverse logarithmic 
function, the extensivity of 5bgs is preserved (see Eqs. (p~5)) and (|17|) for Q — ► Qq). This observation is of major 
importance for our further investigation. It means that JF may lead to correct results if the following two conditions 
are satisfied: i) the entropy definition is of trace-form, as in Eq. (|13p and ii) the derivation of its inner structure 
presents the form 



dx 



A Q (x) = ln s (l/x) + 



x-T^ Q (l/x) 
ax 



/i(Q)ln s (l/x)-/ 2 (Q) 



(19) 



with the constraints limg^g fi(Q) = limg^g /2(Q) — 1- We notice that the nonsingular functions /i(Q) and /2(Q) 
are independent from the variable x. The second condition guaranties the extensivity of the entropy Sq. ^From the 
middle and right hand side of Eq. (fT9)) we can determine the structure of the deformed logarithm lng. Substituting 
Vq( x ) = l n Q(l/ x )) a Q( x ) = (1 — fi(Q))/x and b Q (x) = -f2(Q)/x, we obtain 



y' Q (x) + a Q (x)y Q {x) = b Q (x). 
This is a first order ordinary linear differential equation. Its solution is given as follows 



Vq{ x ) = x* 1 ^ X c\ — 



where c\ is the integration constant. In the limit Q — > Qo Eq. pT|) should tend to yQ a {x) = ln(l/a;). 
constraint into account, we can easily verify that the constants c\ and /2(G) must be of the form 



(20) 
(21) 

Taking this 



(22) 
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Resubstituting lng(x) — > Uq(1/x), we obtain 



a;i-/i(S) _ i 

Ina(*) = 1 _ /i(Q) ■ (23) 



In other words, JF leads to correct results only when the trace-form entropic structure Sq is based on the deformed 
logarithm (f2"3"| . For Q = Q\ = fi(Q) = q the respective entropy is Sj in Eq. Here, it becomes evident why the 
results of the JF and GMC approaches coincide in the case of Tsallis entropy, while for and S^ they do not. In 
further, we shall give some more examples where JF does not gives proper results. 



A. Kaniadakis /t-Entropy 

An entropic structure emerging in the context of special relativity, is the one defined by Kaniadakis [24[ as follows 



s { K }(Pi) = ^2 Piln{ re }(l/Pi), 



with the K-generalized logarithm 

ln{ K }(x) := 



2k 



(x > 0, ln {K _ }(^) = ln(x)) . 



The inverse K-generalized logarithmic function has the form 



ex P{ K }( x ) = kx+^1 + k 2 x 2 (exp {K ^ 0} (x) = exp(x)J 



(24) 



(25) 



(26) 



which maximizes, according to our previous discussion, the entropy S K . However, computing the inner structure of 

d 



S{k}> we obtain 



dx 



[xln K (l/x)] = /i(k) m«(l/x) - / 2 (k;x), 

= 1 - «, 
f 2 (n;x) = x K . 



(27) 

(28) 
(29) 



As can be seen the function /2(k;x) presents explicit dependence on x and thus the variation of the functional 
I(x = pi) in Eq. J2} for Sq = S K can not reproduce PDFs of K-exponential type. 



B. Schwammle-Tsallis gq'-Entropy 

The application of the q-logarithm ([6]) on y-multiplied variables gives an ordinary sum of g-logarithms applied on 
each variable separately. An interesting mathematical question is whether one can define a deformed logarithm whose 
application on a g-product would give a deformed sum of these logarithms. This point was explored in Ref. [25| by 
Schwammle and Tsallis who introduced the two parametric generalized logarithm 

ln q T q '(x) ■= Iry (exp (]n^{x)^J (inf^i,,'-^) = hix) (30) 

with its inverse function 

exp^,(x) = expj (In (expj(x))) (expp^^^x) = exp(x)) . (31) 
The respective entropic structure based on Eq. (|30p is of the form 



i=l 



(32) 
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The derivative of its inner structure leads to the following result 

,ST /, / J _ , , i.j, ST 



d 

d.r 



x ^q,q-{ l / x ) = fi{q,Q';x)\n qq ,(l/x) - f 2 (q;x), 



f 1 (q,q';x) = l-(l-q')x' 



f2(q;x)=x«- 1 . 

Same as in the case of Kaniadakis entropy l|24p . from Eqs. 
function (I3T1) cannot be obtained from JF. 



(33) 
(34) 
(35) 



5]) it becomes obvious that the deformed exponential 



C. Borges-Roditi (/(/-Entropy 

Another two-parametric trace-form entropy, ^ = X)i=™i* x Pi m <j q' (VP*)) ^ s ^ ne one proposed by Borges and Roditi 
in Ref. [2f|, based on the deformed logarithm 



ln^i j(Z ^i(x) = In a; 



(36) 



S^, is generated by applying the (/(/'-generalized derivative introduced by Chakrabarti and Jagannathan [27| on the 



probability functional g(a) := YliPii with respect to a, and then setting a = 1. Eq. (f3"6")) is not analytically invertible. 
The ordinary derivative of the inner structure of Sz^i yields the following result 



d 
dx 



x\n^{l/x)\ = hfaflhffiil/x) - f 2 (q;x), 

h(q,q') =q + q', 

qxi'^ 1 



f 2 (q,q';x) 



q'xi- 1 



(37) 
(38) 

(39) 



In contrast to Schwammle-Tsallis case, the function fx does not depend on the variable x. On the other hand, 
the existence of the x-dependence in fi implies that the type of the probability distribution computed from JF 
is not the inverse ln^ -function and thus does not preserve extensivity of the respective entropy. We notice that 
for q' — > 1/(7, S^R tends to the one-parametric quantum group entropy introduced by Abe [HI]. Accordingly, the 
maximum probability distributions of Abe's definition obtained from JF do not optimize quantum group entropy 
either. 



D. Anteneodo-Plastino 77-Entropy 

In Ref. [29l | Anteneodo and Plastino have constructed a generalized entropy S v whose maximization according to 
JF yields PDFs of stretched exponential type. In terms of a deformed logarithm this entropy is given as 

"max 

Sy(Pi) = ^ Pi^yO-fPi) (Sr,^i = Sbgs) , (40) 

i=l 

where 

ln n (x) :=xr(v±±,lnx) -r(^-), Qn^i(z) = In (x)) . (41) 



V / \ V 

Considering Eq. (|4"Tj) we observe that the inverse function of the ^-logarithm is not a stretched exponential one. 
Thus, a stretched exponential function does not make the entropy extensive. Additionally, the 77-logarithm is not 
analytically invertible. 
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E. Thurner-Hanel gg-Entropy 

Thurner and Hand in Rcf. [30] have estimated the difficulty of obtaining the proper maximum PDFs for an entropic 
form within JF created by the term x-^ 1iiq(1/x) in the middle hand side of Eq. (jTHJ) . In order to solve this problem 
they added one more term in the BGS-entropy definition, whose structure eliminates the aforementioned term. Their 
entropy definition S gg is given as 



Pi ln g g(ft) - 



Pi j d\n gg (x) 
dxx 



dx 



E 



dx ln gg (x) + c 



(42) 



where c is a constant. Indeed, in this case the application of JF on S gg leads to the inverse function of ln gg (pi), 
namely, exp gg (pi). However, the authors did not take into account that the addition of the integral-term may break 
the extensivity of S gg . Let us see this situation closer. For equal probabilities S gg tends to 



S gg (max) — — figf a . 



dxhi gg (x) + c. 



(43) 



Since exp gg is the inverse function of ln gg , the maximum configuration function has the form Q$ 



exp gg (N ln gg (W)). Assuming, that \n gg (x) is integrable with J" dx \n gg (x) — ln gg (l/y) and ln gg (0) = 0, and 
substituting Y = N\n gg (W), then we obtain 



S gg {max) = - cxp gg (y) ln gg (l/ exp gg (F)) + c. 
Extensivity is succeeded in S gg (max) when the following condition is fulfilled 



ln S5 (l/exp ff9 (y))=-r/exp g9 (r) 



rfexp gg (y) 
dY 



exp„„(y) 



ln gg (l/exp sg (y)) + y 



(44) 



(45) 



Under specific assumptions the authors presented analytical expressions of the functions exp gg and ln gg given as 
follows 



ex P gg (i; x ) : = ex P ~( n J 2 ) 1 [erf 1 (2"fV^x)Y 



(exp gg (7 -> 0; x) = exp(x)) 



ln ss(7; x) := - (2 7 ) ^rf (jy/-nm{xf) (ln gg (7 -> 0; x) = ln(x)) . 



(46) 
(47) 



One can easily verify that the generalized definitions (|4"6"]) and (|47[) do not satisfy the condition l[43|) and thus S gg (max) 
depending on ln gg (7;x) does not become extensive for PDFs of exp gg (7;a:) type. We would like to stress that the 
structure of entropy (|4*2T) has been first introduced in Ref. [3l| based on a different context. 



IV. CONCLUSIONS 



We have shown that the application of Jaynes' Formalism on an arbitrary generalized entropic structure may 
yield incorrect types of maximum entropy probability distributions. There are two necessary conditions that must 
be fulfilled, in order to obtain proper results from the aforementioned formalism. The first condition is related to 
the structure of a generalized entropy definition Sq depending on a parameter set Q = {Qi}i=i,...,n, which must 
be of trace-form, S Q = J2i^a(Pi) = J2iPi(^a(Pi)/Pi) = Sjft ln Q(Vi?i) witn m a(Pi) : = Pi^Q^/Pi)- The second 
condition, given in Eq. (|19p . preserves the very important property of extensivity of the entropy Sq. From Eq. (|19|) 
we could determine the explicit structure of the Q-logarithm lng, presented in Eq. (|23[) . This is the only generalized 
logarithm under which the ordinary extremum constraints of the Boltzmann-Gibbs-Shannon entropy do not change. 
For Q = Qi = q and fi(Q) = q the deformed logarithm lng tends to the one defined by Tsallis and coworkers and 
the respective deformed entropy Sq is Tsallis entropy Sj. 

Inverting the above statement, we sec that the definition of the extremum constraints depends strongly on the 
structural choice of the generalized entropy. This implies that the generalization procedure of the Boltzmann-Gibbs- 
Shannon statistics is not a pure mathematical concept but it carries physical information. The physics of a statistical 
ensemble is projected on the extremum constraints. Thus, one should be very careful about the choice of the Sq, since 
changes in the extremum constraints indicates changes in the physics of the system under consideration. It becomes 
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evident at this point why the choice of Tsallis entropy as a possible generalization of the Boltzmann-Gibbs entropy 
in statistical thermodynamics is so special. 

In the frame of Tsallis generalized thermostatistics, based on the entropic structures Sj and Sj_ q for the respec- 
tive parameter ranges [0,1] and [1,2], the correct maximum entropy probability functions (p' nax = 1/exp (x) — 
exp 2 _ 9 (— x) andpf ax = 1/ exp 2 _ 9 (x) = exp ? (— x), respectively] , within Jaynes' Formalism are associated to the ordi- 
nary mean value definition. Furthermore, in a recent study [321 ] Abe showed that the escort probability distributions 
g{pi) = pi I X^fcPfc' wn i crl have been widely used in the literature, are not stable for specific probability perturbations. 
Considering the above results we conclude that the introduction of the aforementioned escort probability distributions 
g{pi) has no physical hypothesis within generalized thermostatistics. 
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